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(54) A computer controlled telephone apparatus 



(57) 



A telephone apparatus is disclosed, comprising: 
a telephone set 1 for implementing telephony actions on a telephone line, said telephone set including a 
senal interface 9 for bidirectional communication of data signals; and 

a computer executable software application for receiving first ones of said data signals from said 
telephone set and in response implementing predetermined software functions, and for transmitting further 
ones of said data signals to said telephone set in response to a user input whereupon said telephone set 
implements predetermined ones of said telephony functions. The serial link is either a Universal Serial Bus 
(USB) or an RS-232 link. The controlling software operates in a windows type environment and telephone 
functions are controlled on-screen using drop-down menus, on-screen buttons and icons. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal 



copy. 
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Set-up the voicemail message your callers hear in three parts, 
rn First record how you want to greet them, next let them know your 
^ status and finally instruct them on what to do next. 
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SYSTEM FOR INTERACTIVE CONTKnr OF CQMPT n"FR AMD TFT PPHnvir 
Field of the Inventing 



This invention relates in general to personal computers and telephony, and 
more particularly to an interactive system by which a computer and telephone 
function cooperatively to implement a multiplicity of functions invoked by a user. 

Backgroun d of the tnventint) 

Software applications are known in the art for implementing telephony 
features using a personal computer. According to existing First Party Call Control 
architectures, a physical connection is provided between the telephone and personal 
computer for providing Computer Telephony Integration (CTT). Such prior art CTI 
architectures have suffered from extreme limitations in functionality and ease of use. 
For example, in order to place a phone call, a user typically must first close or 
minfini7ft whatever application he or she is currently running (eg. Microsoft Word®), 
open the CTI application, enter the digits to be dialled via point-and-click numbers, 
and then click an accept or dial button. Alternatively, according to some CTI 
architectures, the user is able to navigate or browse a telephone directory in order to 
identify the parry to be called and then, once located, highlight the party's name and 
click a dial button. 

Understandably, the awkwardness of using such systems and the limits 
features provided thereby have led some consumers to abandon prior art CTI systems 
in favour of more functional telephone sets or even "plain old telephone sets" (POTS) 
with enhanced features being provided by the central office. 

One of the reasons for the awkwardness and limited functionality of prior art 
CTI architectures is that there is no seamless integration of functions activated by the 
telephone and functions activated directly or mdirectly by the computer. 



Recent developments in the standardization of computer interfaces have led to 



increased development of software applications which are adapted to integrate 
functionality of a personal computer with various and diverse external devices. For 
example, the recently established standard for USB (Uni versal Serial Bus - a 12 
Mbit/s serial interface running over a four wire bus, with an associated software stack 
supporting peripheral connectivity to a personal computer) is expected to yield a raft 
of software applications which interact cooperatively with external devices ranging 
from video games to faxes and data modems. < 

An object of the present invention is to provide an interactive telephone and 
PC-based software application which will overcome the limitations of prior art CTT 
architectures and be compatible with emerging standardized interfaces such as USB. 

Summary of the Invention 

According to the present invention, an interactive system is provided by which 
a computer and telephone function cooperatively to implement a multiplicity of user- 
invoked features. Physically, the system comprises a telephone set which is 
connected to a personal computer on which a novel TAPI (Telephony Application 
Program Interface) application is executed. The telephone set includes a plurality of 
user-definable function keys in addition to the keypad, handset, speaker phone and 
other standard components. The user-definable function keys are programmable via 
the computer to implement specific telephony features or to launch applications on 
the computer. The TAPI application permits shared and interactive functionality 
between the computer and telephone set including, but not Kmitrd to, call 
management, call logging, call recording, phonebook database creation and editing, 
and dialling. The telephone set is connected to a single central office line, and can be 
connected to the computer via either a USB or a standard RS-232 serial line. 

The TAPI application according to the present invention comprises a plurality 
of user interfece components for user display and printing, and a plurality of engine 
components for call processing, data storage and manipulation, application 
configuration management and audio recording and playback. The engine 



components are located in one or more Dynamic Link Libraries (DLLs) to provide the 
necessary information for display or printing by the user interfece components. The 
user interfece components are contained in a main executable file and are isolated 
from the non-user or engine components to allow for flexibility in future interfece 
developments. 

The user interfece components of the present invention provide a graphical 
user interfece (GUI) characterized by a number of useful features. According to one 
aspect of the GUI, a "flyout" control bar may be activated by the user to display 
various context sensitive call features. According to another aspect, where caller line 
identification data (CUD) is sent to the user's system, the caller's picture is displayed 
on-screen as a bit map, along with the user's name and telephone number. According 
to an additional aspect, the user can program a plurality of custom diallers which 
operate in a manner somewhat similar to speed diallers except that the diallers are 
logically sequenced by the user for navigating automated attendants and other 
comparable call answering systems. 

Brief Description of the Drawing 

A detailed description of the preferred embodiment is provided herein below 
with reference to the following drawings, in which; 

Figure 1 is a schematic illustration of the computer-based telephony system 
according to a general aspect of the present invention; 

Figure 2 is a block diagram showing software modules which form the 
protocol stack governing communication between the telephone set and computer of 
the telephony system according to the present invention; 



Figure 3 shows a main window display generated by the software application 
according to a first embodiment of the present invention; 



Figure 4 shows the main window display of Figure 3 with a flyout control bar 
thereof in the open position; 



Figures 5a though 5c show the main window display according to an 
alternative embodiment of the present invention, wherein Figure 5a shows the main 
window display with toolbar showing, and Figures 5b and 5c show the main window 
display with control bar actuator positioned n the right and left, respectively; 

Figures 6a though 6c show a receptionist icon or indicator of a status line of 
the main window according to the first embodiment; 

Figures 7a though 7c show a voicemail icon or indicator of the status line of 
the main window according to the first embodiment; 

Figures 8a though 8d show a "Do Not Disturb" icon or indicator of the status 
line of the main window according to the first embodiment; 

Figure 9 is a block diagram showing user intexfece components of the 
software application and engine components of the core software module executed by 
the computer according to the present invention; 

Figures 10 shows the main window display of the first embodiment in the 
event of an incoming call (Figure 10a), with the control bar in the open position 
(Figure 10b), and with the Phone menu open (Figure 10c), whereas Figure lOd shows 
the main display according to the alternative embodiment; 

Figure 1 1 shows the main window display according to the first embodiment 
when an incoming call is sent to voice mail (Figure 1 1 a), with the control bar in the 
open position (Figure 1 lb), and with the Phone menu open (Figure 1 1c); 

Figure 12 shows the main window display according to the first embodiment 
when a voice mail message is being recorded (Figure 12a) and the user picks-up the 



call (Figure 12b); 



Figure 13 shows the main window display according to the first embodiment 
when a call is diverted to hold; 

Figure 14 shows the main window display according to the first embodiment 
during a hang-up sequence beginning with the user hanging up (Figure 14a), the call 
state being indicated as "Hanging Up" (Figure 14b), and finally the call state being 
indicated as "Your Line is Free" (Figure 14c); 

Figure 15 shows the main window display according to the first embodiment 
during a direct dial sequence beginning in the idle state with the user clicking the 
"Make a call" default button (Figure 1 5a), Mowed by positioning of the cursor over 
the Number field and the call state being indicated as "Enter a phone number" (Figure 
15b), entering of dial digits (Figure 15c), and finally upon a match between the 
entered dial digits and a number stored in the Phonebook, the caUed jjarr/s name is 
displayed along with a call timer tor the duration of the call (Figure 15d); 

Figure 16 shows the main window display acc»rding to me rim embodiment 
during an on-hook dial sequence beginning in the idle state (Figure 16a), followed by 
positioning of the cursor over the Number field and entering of dial digits (Figure 
16bX as digits are entered, if a match is fourdm the Phonebook, me naxne of the 
person being called is displayed in the Name field (Figure 16c), clicking of the "Make 
a Call" icon appearing in the defeuk button (Figure 16d), and finally initiating the call 
and displaying the call timer (Figure I6e); 

Figure 1 7 shows the main window display according to the first embodiment 
during a dial by name sequence beguming m the idle state (Figure 17a), 
positioning of the cursor over the Name field and entering of letters of the name of the 
person to be called (Figure 1 7b), as letters are entered, if a match is found in the 
Phonebook, the name and detank telephone number of the person being called ; 
displayed (Figure 17c), selecting a different phone number for the person being 



are 



called, from a drop-down list (Figure 17d), clicking of the "Make a Call" icon 
appearing in the default button (Figure 1 7e), and finally initiating the call and 
displaying the call timer (Figure 1 70; 



Figure 18 shows the main window display according to the first embodiment 
during a speed dial sequence beginning in the idle state with the user selecting a "Dial 
"menu item from the menu bar (Figure 1 8a), selecting a name and number from the 
"Speed Dial" list Figure 18b), displaying the selected name and number are displayed 
(Figure 1 8c), initiating the call and displaying the call timer (Figure 1 8d); 

Figure 1 9 shows the main window display according to the first embodiment 
during a drag-and-drop name search and dial sequence, beginning in the idle state 
(Figure 1 9a), highlighting and dropping a portion of text from another application into 
the Name field such that the Phonebook is automatically searched and in response to a 
match the default number associated with the matched name is displayed in the 
Number field (Figure 1 9c), clicking on the default button resulting in a line being 
selected and digit out-pulsing (Figure 19d), and once the dialling is complete, display 
of the call timer (Figure 19e); 

Figure 20 shows the main window display according to the first embodiment 
during a hang up, beginning with clicking on the "Hang Up" icon of the default 
button (Figure 20a), displaying a "Hanging Up' message (Figure 20b), and finally 
returning to the idle state (Figure 20c); 

Figure 2 1 shows an extension in use indicator of the main window display 
according to the first embodiment; 

Figure 22 shows the main window display according to the first embodiment 
during a sequence of adding a party to the Phonebook from the connected state 
(Figure 22a) where the user activates the control bar (Figure 22b), and therefrom 
activates a Phonebook window (Figure 22c) from which a Profile window can be 
activated (Figure 22d); 



r igurc miuw> * wont bo oi me rrome winaow, a Home tab is shown in 
Figure 23b, a Phone tab is shown in Figure 23c. a Personal tab is shown in Figure 23d 
and a Shortcuts tab is shown in Figure 23e; 

Figure 24 shows the main window sequence according to the first embodiment 
for playing a voicemail message from the idle state with a message waiting icon 
flashing (Figure 24a), with a tooltip indicating the number of messages waiting 
(Figure 24b), with a shortcut mouse click to open voicemail (Figure 24c) and 
displaying the voicemail subdirectory of a Call Log and superimposed recorder 
window; 

Figure 25 shows various window displays indicating operation of a user 
customizable dialler feature according to the first embodiment, wherein Figure 25a 
shows access to the dialler feature via the Tools menu of the n«i n window, Figure 
25b shows a series of user defined categories or sections of the dialler, Figure 25c 
shows a particular section in an open state, and Figure 25d shows an editing feature 
for a selected button; 

Figure 26 shows a Personal Assistant window according to the alternative 
embodiment including a plurality of tabs identified as Call Screening (Figure 26a), 
Call Blocking (Figure 26b), Greetings (Figure 26c) and Personal Messages (Figure 
26d); 

Figures 27a through 27f show a configuration window having multiple user 
selectable tabs for configuring the telephone and application, wherein Figure 27a 
shows a Sounds tab, Figure 27b shows an Incoming Calls tab, Figure 27c shows an 
Audio Devices tab, and Figure 27d shows a Function Buttons tab, Figure 27e shows a 
Voicemail tab, and Figure 27f shows a Miscellaneous tab; and 

Figure 28 shows a Sound Manager window for effecting sound recording and 
editings 



8 

Detailed Description of the Preferred Embodiment 



Turning to Figure 1, the computer-based telephony system of the present 
invention is shown in its broadest aspect comprising a telephone set 1 connected to a 
telephone switching system 3 (e.g. central office) via a telephone line 5. The 
telephone set 1 is also connected to a personal computer 7 via a serial link 9. The 
personal computer 7 includes a monitor or display 8 as well as a mouse pointer 10 and 
keyboard 12, in a well known manner. According to the preferred embodiment, the 
serial link is one of either a USB or RS-232 line, although other suitable data 
communication links are possible. The computer 7 executes a TAPI compliant 
software application for communicating with the telephone set 1 to implement various 
telephony functions, as discussed in greater detail below. 

The telephone set 1 includes a handset 1 1 and keypad 13, and in addition 
includes a plurality of programmable function keys 1 5. As discussed in greater detail 
below, respective ones of the function keys may be pro gr am med via the software 
application executed on computer 7 to activate predetermined telephony functions or 
software functions on the computer. For example, in one scenario a function key may 
be programmed to automatically activate a "Do Not Disturb" feature while in another 
scenario the function key may be programmed to launch a software application such 
as Microsoft Word®. The set 1 also includes a message waiting lamp 16 which is 
activated by the software application to notify the caller of an incoming message, 
which can be a voicemail message, a fax, Internet email or other multimedia message. 

As indicated above, the software application running on computer 7 
communicates with telephone set 1 via serial link 9. As shown in Figure 2, in order 
for this communication to take place, data must pass through a plurality of modules 
which form a protocol stack between the application 17 and telephone set L The 
telephone set 1 incorporates a microprocessor 19 (e.g. Intel 80930) with Flash 
EPROM memory 21. A modem 23 is connected to microprocessor 19 and is 
provided with a Flash memory 25. The microprocessor 1 9 and modem 23 together 
control implementation of standard telephony functions such as incoming call, 



outgoing call call waiting, speaker phone conversation, hold, etc., in a well known 
manner. However, in accordance with the principles of the present invention, the 
software application 1 7 is able to interact with the telephone set 1 to cooperatively 
implement a multiplicity of user-invoked features. 

Although the software modules comprising the protocol stack do not form part 
of the present invention, a brief description is provided herein for completeness. The 
highest level in the stack is represented by the software application 1 7 which 
comprises a plurality of user interface components for display and printing 
fimctionality, as discussed in greater detail below with reference to figure 9. 
Immediately below the appUcation 1 7 is a core 27 comprising a piuraUty of engine 
components for providing ail of the support which the user interface components 
require to display and print data. This support includes call processing, data storage 
and manipulation, appUcation configuration management and audio recording and 
playback. The engine components are located in one or more DLLs with "C" 
language interfaces to them, as discussed in greater detail below. 

According to the preferred embodiment as of the filing date of this appUcation, 
the appUcation 17 is coded in VisuaiBasic whereas the core 27 of engine components 
is coded in C++. To facilitate access from VisuaiBasic to the DLLs, an OCX layer 29 
is provided. The OCX layer 29 is also coded in C++. 

Below the OCX layer is TAPI layer 3 1, which is a Microsoft device 
independent communication Ubrary created by Microsoft for use by programmers 
writing telephony appUcations (including data, fix and voice modem) for Microsoft 
operating systems. 

Below TAPI layer 31 is a TAPI service provider referred to as 
M Musmdm.Tsp ,, layer 33. This layer communicates with Microsoft's 
-UmmodenVV.Tsp'' and "Unim«iem/V.Vxd» layers 35 and 37, respectively, which 
form the standard Windows 95® low-level software architecture for supporting 
telephony appUcations utilizing voice/data/fex modems. 
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The "Unimodem/V .Vxd" layer 37 communicates with a Mitel. Vxd layer 39 
which provides an interface to the standard VCOM layer 41 . VCOM layer 41 is a 
static VxD which is loaded when booting Windows 95, and which functions as a 
device driver interface to the devices connected to serial link 9 (ie. USB or RS-232 
port drivers). 

Since the UniModem V architecture does not support a number of essential 
telephony signals, such as keypad, hookswiteh, hold, etc., a 16 bit/32 bit "thunking 
layer" 43 is provided for circumventing the UniModem V layers for these signals. 

At the lowest levels of the protocol stack, VCOM layer 41 communicates with 
one of either with a VCOM mapper 45 for the USB version of this invention or a 
VCOM port driver referred to as MSeriaLVxd 47. 

For the USB version, VCOM mapper 45 communicates with a USB device 
driver "musb-sys" 49 for causing the USB to "appear" as a serial port. The 
"musb.sys" driver 49 communicates the standard Microsoft USB stack and associated 
hardware 51 for transmitting and receiving serial rfata via the USB. 

For the RS-232 version, the MSeriaLVxd driver 47 communicates with a 
UART 53 (Universal Asynchronous Receiver Transmitter) in a well known manner. 

At the telephone set 1, the USB hardware 51 communicates directly with 
microprocessor 19 via associated USB hardware incorporated into the 
microprocessor, whereas for the RS-232 version UART 53 communicates with a 
further UART 55 connected to the microprocessor 19. 

As indic a ted above, the user interface components of application 17 are 
responsible for implementing a Graphical User Interface (GUT) which allows the user 
to access various software and telephony features. The principal user interface to 
these features is provided by the main window 57 which is depicted via display 8 of 
computer 7. Two embodiments of the GUI are discussed herein. A first embodiment 



ia uuuau/ M iuwn m ngure j wane an auemaave embodiment is initially shown in 
Figure 5. The basic user functionality provided by the two embodiments is similar. A 
detailed description of the functionality is described herein in detail with reference to 
the first embodiment, and supplemented where appropriate with reference to the 
alternative embodimenL As of the date of initial filing of this appucation, the second 
embodiment constitutes the best mode, the operation of which will be understood by a 
person of ordinary skill in the art having reference to the detailed description of the 
first embodiment supplemented by reference to the second embodiment disclosed 
herein. 



The main window display according to the first embodiment (Figure 3), 
includes a title bar 59 with document control menu icon as well as minimis and close 
buttons, a customizable toolbar 60 with volume, speaker, microphone, voicemaiL 
profile, phonebook, call log and help buttons showing, a display area 61 with name 
field, number field and call state information, a context sensitive default button 63 
which has focus and responds to the "Enter" key from the keyboard of computer 7 
(unless the focus is changed by the user), a control bar actuator 65, a menu bar 67, 
resize control 69, and a status line 71 with indicators including receptionist icon 73, 
voicemail icon 75 and w Do Not Disturb" icon 77. 

A horizontal control bar 79 can be opened from the main window display 57, 
as shown in Figure 4. The control bar 79 opens when the screen pointer of mouse 10 
passes over the control bar actuator 65 (similar to the auto bide/show feature of the 
Windows 95® task bar), and can be programed to open automatically in the event of 
an incoming call at telephone 1 . According to one embodiment of the invention a time 
delay is provided (e.g. 02 sees) after positioning the mouse pointer over the actuator 
65, in order to prevent accidental inadvertent opening of the control bar 79. The 
control bar 79 remains open as long as mouse pointer 10 is positioned over any one of 
the function buttons 8 1 . Preferably, a time delay is provided (e g. 0.5 sees.) after the 
mouse pointer 10 has moved from the control bar 79 before the control bar is closed. 
The control bar 79 may also be opened using a keyboard sequence (such as Alt+tn). 
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In the event that the user drags the main window display 57 to the right side of 
display 8 so that there is no longer sufficient room for the control bar 79 to open to 
the right, the control bar and associated default button 63 swap positions with the 
display area 61 and the control baropens to the left ofthe main window display 57. 
This feature ofthe invention is shown in Figure 5b and 5c, which show the main 
window display 57 according to the alternative embodiment. 

The control bar 79 provides a normally hidden menu of function buttons 8 1 to 
the user. The buttons 8 1 are preferably labelled with icons and text By keeping the 
control bar 79 closed during normal operation, considerable screen real estate is 
saved. Opening of the control bar 79 provides the user with immediate access to call 
handling features without having to scroll through a multitude of menus or buttons, 
waiting for tool tips to pop-up, etc., as is common with prior art CTT applications. 
Furthermore, according to an important aspect ofthe invention, the defeult button 63 
and buttons 8 1 of the control bar 79 are context sensitive so as to provide 
functionality derived from all parts ofthe software application 17, but only function 
options which are appropriate to the state ofthe telephone call (e.g. when a call is in 
progress, as shown in Figure 4, the options are Hang Up, Hold, Recorder and Open 
File). 

According to the embodiment shown in Figure 3, the options of menu bar 67 
include: 

0 a File menu for providing access to Import and Export functions (e.g. links 
to contact lists from other PIMs, etc.), and an Exit command which quits the 
application 17; 

ii) an Edit menu which provides access to well known cut, copy, paste and 
delete co mm a nds, which may be used to modify both the name and number fields of 
display are 61; 

iii) a View menu which allows the user to hide or show the toolbar 60 within 
main window 57; 

iv) a Phone menu for presenting various telephony function options to the 



user for call handling - as with the default button 63 and function buttons 8 1 
discussed above, the telephony function options presented in the Phone menu are 
made context sensitive by dinuning commands which are not appropriate to the 
telephone call state; 

v) a Dial menu which presents the user with a list of user definable important 
or frequently dialled numbers as well as a Calls Made list and Calls Received list -the 
Dial menu including: 

- a Speed Dial sub-menu defined by the user in the phonebook such that for 
each person in the list, all relevant phone numbers are displayed. Upon 
selection of a phone number, the name and number are dropped in display area 
61, the telephone 1 goes off-hook and digits are immediately out-pulsed; 

- a Calls Made sub-menu for providing the user with a list of the last 20 people 
who were called, sorted by date and time, with the last person caUed appearing 
at the top of the list; 

" a 03118 Received sub-menu for providing the user with a list of the last 20 
people who called, sorted by date and time. 

vi) a Tools menu 74 (see Figure 25a) for providing the user withaccessto 
advanced features of the application 1 7, such as: 

- a Phonebook sub-menu for providing the user with access to various 
phonebook functions and directories; 

- a Messages sub-menu for providing the user with access to messaging 
functions, greetings as weU as voicemail messages left for the user in the Call 
Log (discussed below); 

- a Call Log sub-menu which opens the user's call log, (discussed below); 

- a Gall Screening menu the call screening functions or off ^ sending 
incoining calls, except those in the Call Screen folder of the phonebook, to 
voicemail without disturbing the user; 

- a Recorder menu item for opening the Recorder window for recording a 
conversation; 

- a Diallers sub-menu for providing a list of user defined buttons which can be 
used for speed-dialling or navigation (discussed in greater detail below). 
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The options of Menu bar 67 according to the embodiment of Figure 5 are 
similar, except that there are no View and Dial menu items. 

As indicated above, and as shown in Figures 6a to 6c, the status line 7 1 
includes a receptionist icon 73 for indicating that the receptionist function is active, 
meaning that advisory messages and personal messages are automatically played for 
specific callers based on CUD. As shown in Figure 6b, when the mouse pointer 10 
enters the bounding box of receptionist icon 73, a tool tip box 78 opens displaying the 
current message to be played for incoming callers who are sent to voicemail. A right 
mouse button click when the mouse pointer 1 0 is over the receptionist icon 73 opens a 
shortcut menu 80 for selecting advisory messages, as shown in Figure 6c. 

In the alternative embodiment shown in Figures 5a through 5c, the receptionist 
icon 73 appears as a button for implementing predetermined features such as call 
screening, call blocking, greetings and personal messages, all of which are discussed 
in greater detail below. 

The status line 7 1 also includes a voicemail icon 75 which functions as a 
messages indicator to alert the user to any new voicemail messages. As shown in 
Figures 7a to 7c, when messages are waiting the icon flashes (Figure 7a). As shown 
in Figure 7b, when the mouse pointer 10 enters the bounding box of voicemail icon 
75, a tool tip box 82 opens displaying the number of new messages. A right mouse 
button click when the mouse pointer 10 is over the voicemail icon 73 opens a shortcut 
menu 84 for accessing voicemail messages, as shown in Figure 7c. A double click 
opens the voicemail folder of the Call Log, as discussed in greater detail below. 

A tt Do Not Disturb" icon 77 is included in the status line 71, as shown in 
greater detail with reference to Figures 8a to 8d. The "Do Not Disturb" icon 77 alerts 
the user that some or all callers are benig prevented from calling in (see Figure 8a). 
As shown in Figure 8b, when the mouse pointer 10 enters the bounding box of "Do 
Not Disturb" icon 77, a tool tip box 86 opens displaying the status of Call Screen. A 
right mouse button click when the mouse pointer 10 is over the voicemail icon 73 



in 
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opens a shortcut menu 88 for turning the Call Screen function on or off; as shown 
Figure 8c, while a double click toggles between the on/off states. Figure 8d shows 
the icon 77 indicating that Call Screen is off. 

In the alternative embodiment of Figure 5, a bell icon 72 is provided for 
opening a sound manager window for creating or changing sounds and assigning 
predetermined sounds to different functions, as discussed in greater detail below. 

Turning now to Figure 9, the user interface components of software 
application 17 and the engine components of core 27 are shown in greater detail. All 
communications between the engine components and the user interface components 
are provided through a main window component 83. The main window component 83 
displays the main window display 57 including menu bar 67, toolbar 60, status line 
71, display area 61 and default button 63, as discussed above. If the data being 
communicated by the core 27 is intended for a user interface component other than 
the main window component 83, the mam window component routes it appropriately. 

A display window component 85 functions in conjunction with the main 
window component 83 to generate display area 61 for showing line and call 
information. 

Flyout menu component 87 displays the context-sensitive control bar 79 for 
providing push-button-style menu selections. 

The application configuration dialog 89 and phone configuration dialog 91, in 
combination allow the user to configure the software application, as discussed in 
greater detail below with reference to Figure 27. 

The group editor 93 allows the user to manipulate entries in a Call Screening 
list. Call Blocking List or Speed Dial list, as discussed in greater detail below. 



The directory component 95 displays information relating to the user's 
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business and personal contacts. The Phonebook is analogous to a Personal 
Information Manager (PIM). The Phonebook display is discussed in greater detail 
below with reference to Figure 23, and contains the following tabs: 
Home - Name and home address 

Work - Name, company name, type of contact and business address 

Phone Numbers - Home, business, fax and cellular phone numbers 

Personal - User selectable greeting and message preferences 

Notes - Editor OCX that supports sound objects 

Shortcuts- Window with preferred application icons (e.g. Microsoft 

Word®, Excel®, etc.) which are automatically opened when 
the contact is called or when the contact calls 

The user can configure programmable icons using the programmable icons 
dialog 97. These icons can be programmed to access CO voicemail and IVR systems. 

The voice record dialog 99 allows the user to record greetings and other voice 
recordings 

The retrieve voicemail dialog 101 is used to access voicemail messages. 

The call log 103 is used to display all telecommunications activity from the 
application 17. 

The about box 105 displays application version information and current 

system Statistics, in a cnnv entintiaj maimer 

When the user wishes to play a voice mail message from Microsoft 
Exchange®, a Microsoft Exchange UI application 107 is invoked, (user interface). 
This application displays controls to play, stop, rewind and fast forward the message. 



The tray icon 109 appears in the Windows 95® task bar. When this icon is 
selected, the tray window is displayed. The tray window provides access to basic 



nincuons 01 tne appucauon 1 /. 



Turning now to the engine components of core 27, call manager 1 1 1 maintains 
call-specific data for all existing calls on all lines. The call manager 1 1 1 uses TAPI to 
obtain the call-specific information it requires. For each call, the following data is 
stored: 

1. TAPI call handle 

2. call state 

3. whether the call is incoming or outgoing 

4. whether the call should be blocked (for incoming calls) 

5. whether the call should be screened (for incoming calls) 

6. digits dialled, name of person called (for outgoing calls) 

7. caller ID number and name (for incoming calls) 

8. call start time, call duration 

9. DTMF digits received (for incoming calls) 

The line manager 1 1 3 maintains line-specific data for all available telephone 
lines. It inter&ces to TAPI 3 1 to perform line-related requests. The line manager 
facilitates multi-line support in the application 1 7. For each line, it stores the 
following data: 

1. TAPI line handle 

2. line state 

3. feature supported by the line 

4. count of rings for an unanswered incoming call 

5. existing calls on the line (actual data is mamtained by caU manager 111) 

6. number of rings to wait before answering incoming calls 

7. voice mail on/off state 



Line manager 133 also performs the following line-related requests: 
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1. dial number 

2. hang up 

3. answer incoming call 

The line manager 1 13 contains a TAPI callback to receive line-specific 
notifications from TAPI layer 31. 

The phone manager 1 15 maintains data that is specific to the telephone I . It 
interfaces to TAPI layer 3 1 to perform phone-related requests. The data maintained 
by phone manager 1 1 5 includes: 

1. status of lamp 16 

2. hookswitch status 

3. phone button data 

The phone manager 1 15 also contains a TAPI callback to receive telephone- 
specific notifications from TAPI layer 3 1 . 

During operation, the telephone 1 needs to know when the application 1 7 is 
active. When the application is not active, the telephone 1 reverts to a regular POTS 
telephone and the programmable buttons 15 lose their functionality. In order to 
determine whether the application 1 7 is active, the telephone 1 attempts to send a so- 
called 'are you alive?' message to the phone manager 1 1 5. The phone manager then 
responds with die appropriate reply. 



ine 



The call control manager 1 17 manages all incoming and outgoing telephoi 
calls in conjunction with the line manager 1 13, call manager 1 1 land phone manager 
1 1 5 to access telephony functionality. The line and phone managers forward required 
call progress events which they receive from TAPI 3 1 to the call control 
1 17. The call control manager 1 17 also manages any audio playback which may be 
required for a calL 
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The database manager 1 1 9 provides an interface to the databases 120 stored 
on disk in computer 7. The databases 120 are preferably stored in Microsoft Jet 
format (MDB). This manager's interface is independent of the database technology 
being used. The database manager 1 19 supports the following functionality: 

1- open and close databases 

2. read and write database table data 

3. perform database queries 

The smart data access manager 121 provides intelligent access and 
modification capabilities to all data required by the engine components of core 27 
(excluding user preference data). For simplicity, the user interface components of 
application 1 7 may implement the data access functionality they require. For the best 
mode of this invention as of its filing date, the user interface components are written 
in VisualBasie®, so that the task of implementing data access functionality required is 
simplified and results in saving the overhead of passing large amounts of data 
between the database and the engine components and then between the engine 
components and the user interface components. The smart data access manager 121 
uses the database manager 1 19 to read and write data that is stored in the databases 
120. 

The smart data access manager 121 supports the following functionality (or 
the subset of this functionality that only the engine components require): 

1. read/write call log data 

a. get Last Number Redial list 

b. get Calls Answered list 

c. get Calls Missed list 

2. read/write Phonebook data 

3. read/write voice mail data 

4. read/write greeting message data 

5. read/write programmable icon data 
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All required queries (known in advance), are understood by the smart data 
access manager 121. This manager is responsible for keeping track of data storage 
mechanisms in use by the application 17. All audio recordings (e.g. greeting 
messages and voice mail messages) are stored as separate disk files. References to 
these files are stored in the databases 120 where needed. 

The call discrimination manager 123 is responsible for determining the call 
type (voice, fax or data modem) of incoming calls, by means of fax tone detection, 
distinctive ring, caller ID and DTMF detection. The call control manager 1 17 passes 
any required call-specific information to the call discrimination manager 123 as it 
becomes available. Once an incoming call has been discriminated, the call 
discrimination manager 123 informs the call control manager of the result If the call 
is a fax or data modem call, the call control manager 117 attempts to pass it to an 
application that can handle it (using the phone manager IIS). 

The registry manager 125 provides an interface to the Windows 95® registry. 

The configuration manager 127 is responsible for maintainin g application 
configuration information and user pr e feren ces on the basis of user input via the 
application configuration dialog 89 and phone configuration dialog 9 1 . The 
configuration manager 127 uses the registry manager 125 to read and write the actual 
data. 

The audio conversion manager 129 supports conversion between the native 
audio format (ADPCM) and the WAVE audio format. The native audio format will be 
used for recording and playback performed by the application 17. Audio files given to 
or obtained from other applications will be in the WAVE audio format. 

The audio I/O manager 131 is responsible for audio file input and output. It 
understands the native format used internally for play and record operations. 



The media message control manager 133 is responsible for 
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I. recording and playing greeting messages 

II. recording and playing voice mail messages 
ELL playing the phone ringing sound 

The call control manager 1 1 7 notifies the media message control manager 1 3 3 
when any of the above functions need to be performed. 

The dialling manager 135 is responsible for processing ail dialling requests 
including making calls from the Phonebook, the Last Number Redial list and the 
Speed Dial list. It also keeps track of all required phone company dialling sequences 
(e.g. 3 -way calling and call waiting). 

* 

The remote retrieval manager 137 is in charge of providing all functionality 
that can be accessed remotely. This functionality consists of: 

L playing, saving and deleting voice messages, 
EL modifying a greeting message 

According to one embodiment of die invention, the date and time that a voice 
message was received may be made available remotely, utilizing a text to speech 
OCX 

The voice mail manager 139 is responsible for playing previously recorded 
voice mail messages locally, either to the handset 1 1 or to a speaker device. This 
manager uses the smart data access manager 121 to get voice mail message file names 
and the media message control manager 1 3 3 to play the messages to the appropriate 
device. . 

The Microsoft Exchange® manager 141 provides an interface to all Microsoft 
Exchange® functionality required by the application 1 7. In order for all voice mail 
messages to appear in the Microsoft Exchange® Inbox, this manager adds a message 
to the Inbox folder of the user's message store for each voice mail message received. 
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As well, when the user wishes to play a voice mail message from Microsoft 
Exchange®, a form application is invoked (as discussed in greater detail herein 
having regard to the Microsoft Exchange UI application 107 which displays controls 
to play, stop, rewind and fast forward the message). 

Since voice mail messages can be played both from the application 1 7 and 
from Microsoft Exchange®, these two applications are synchronized in terms of 
played and deleted messages. If the Phonebook entries of application 17 are to appear 
in the user's defcult Microsoft Exchange® address book, the Microsoft Exchange® 
manager 141 ensures that the Phonebook and address book are kept in sync. 

In order to better understand how the application 17 and engine components of 
core 27 function, several call scenarios are described herein below with reference to 
the first embodiment of the invention, although an understanding of the second 
embodiment will also be obtained th er e fr om. 

A. Incoming Call 

When an incoming call is received, TAPLDLL 3 1 sends a message to the line 
manager 1 13 for each ring. This notification is forwarded to the call control manager 
1 17. On the first ring, the line manager 1 13 creates a new call object using the call 
manager 1 1 1 and the call control manager 1 1 7 notifies the main window component 
83 of the incoming call. In response, the main window 5 7 displays the incoming call 
status as shown in Figure 1 0a wherein defeult button 63 displays a flashing bell icon. 
In Figure 10b, the control bar 79 is shown in the open position for displaying various 
call answer options (other than the default option provided by button 63 ), while in 
Figure 10c the same options are displayed via the phone menu item of menu bar 67. 

With each ring event, the call control manager 117 causes the media message 
control manager 133 to play a "phone ringing' 9 sound to the appropri ate local speaker 
device. If a "caller ED data received" notification is received by the line manager 1 13 , 
the line manager asks the call manager 1 1 1 to store the caller ID data with the call's 
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object. The call control manager 1 1 7 then forwards the information to the call 
discrimination manager 123 and the main window component 83. The majn window 
component 83 and the directory component 95 search the Phonebook directory for a 
match in stored telephone number with the identified telephone number of the calling 
party. In the event of no mateh being found, the unaltered CUD data is displayed in 
display area 61 (i.e. caller name and telephone number). In the event of a match, the 
caller's name and telephone number are displayed in display area 61 of main window 
57. According to the alternative embodiment, the user's image may also be displayed 
as shown in Figure lOcL 

The call control manager 1 17 uses the smart data access manager 121 to 
determine if the call should be blocked or screened* The resulting information is 
stored in the call's object If the call is to be blocked, the call control manager 1 17 
either hangs upon the caller or sends the call to voice 

If distinctive ring data is received by the line manager 113, it is stored in the 
call object and forwarded to the call discrimination manager 123. 

With each ring event, the line manager 113 asks TAPI 31 for the answer ring 
count for the given line. If voice mail is turned on (which is determined from the 
configuration manager 127), after the required number of rings have occurred, the line 
manager 113 answers the calL The call control manager 1 17 then sends the call to 
voice mail, and forwards the information to the main window component 83 for 
display via display area 61 of main window 57, as shown in Figures 11a, lib and 11c 
(wherein reference number 143 represents the Phone menu choice display from menu 
bar 67). 

If a call is sent to voice mail, the call control manager 1 17 gets the file name 
of the gr ee ti ng to be played to the caller from the smart data access manager 121. 
This can be done using caller ID. The call control manager 1 1 7 also obtains the nar^e 
of a file to which the voice mail message can be saved. The two file names are then 
passed to the media message control manager 133. This manager first plays the 
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greeting to the appropriate line device. Once the greeting playback has finished, it 
plays a "beep tone" sound to the line device. Once this sound has finished playing, 
recording starts* When recording has finished, the call control manager 1 17 asks the 
media message control manager 133 to stop recording. At this point, the call control 
manager 1 1 7 sends the voice mail message data to the smart data access manager 121 
which stores it, and the phone manager 1 IS causes the lamp 16 to flash at telephone 
set 1. 

If the user has fax software running on computer 7, the phone manager 1 IS 
ca u s es lamp 16 to flash upon receipt of an incoming fax. Similarly, it is contemplated 
that the lamp 16 maybe caused to flash upon receipt of an incoming email message, 
or any multimedia message received via the computer 7. 

If the user picks up the telephone handset or depresses the default button 63 
while the call is in voice mail (Figure 12a), the call is taken out of voice mail and put 
in conversation mode (Figure 12b). If a voice mail message was in the process of 
being recorded, the voice mail data is sent to the smart data access manager 121. 

If the user requests to divert the call to "Hold" and play the "Please Waif' 
message (e.g. by depressing the "Hold" function button 8 1 (Figure 10b)) , the call 
control manager 117 asks the line manager 1 13 to put the call on hold. Then the call 
control manager 117 sends a request to the media message control manager 133 to 
play the "Please Wait" message. The call control manager 117 also send this 
information to main window component 83 which causes the icon 144 for default 
button 61 to change to "Retrieve from Hold" (Figure 13) and to display an "On Hold" 
message and hold timer 145. 

When the user hangs-up the handset 1 1 or presses the "Hang Up" icon in 
default button 61 to complete the call (Figure 14a), call control call manager 1 17 
advises main window component 83 which generates a "Hanging Up" message 147 in 
display area 61 (Figure 14b), and also retrieves the call data from the line manager 
113 and passes it to the smart data access manager 121 which creates a call log entry 



(described in greater detail below). Then the call object is deleted and call control 
manager 117 advises window component 83 which displays the idle state of window 
57 with a "Your Line is Free" message 149 in display area 61 (Figure 14c). 

B. Outgoing Call 

Outgoing calls can be initiated in a number of ways, such as direct dial, store 
and diaL look-up name, speed dial and drag Sc. drop nai^ into the name field of 
display area 61 , as discussed in greater detail below. 

The user can dial directly from the telephone set 1 by either first picking up 
the handset 1 1 or pressing a speaker key to obtain dial tone and then dialling the 
phone number normally via the keypad 13. The user can also directly dial from 
application 17 , as shown in Figures 15a to I5d. From the idle state (Figure 15a), the 
user clicks the "Make a Call" icon displayed in default button 63. In response, the 
main window component 83 sends a request to the dialling manager 135 to select a 
line. Upon selecting the line, dial tone is generated for the user and the call control 
manag er 1 1 7 sends a message to main window component 83 for causing a cursor to 
flash in the "Number'' field 151 of display area 61 (Figure 1 5b). 

As digits are entered from the keypad 13 or keyboard 12 (Figure 15c), DTMF 
tones are generated and the dialling manager 135 constructs the relevant dial string 
and then asks the line manager 113 for a dialling prefix. If the user wishes to make a 
private call, the appropriate dialling characters are inserted into the dial string. If the 
digits entered match a Phonebook entry, the name of the person being called is 
displayed in the "Name" field 153 of display area 61 and the call timer 155 is 
displayed (Figure 15d). The dial string (and, if known, die of the person being 
called) is then passed to the line manager 1 13 which creates a call object and initiates 
the call. 

The user can also enter a phone number while on-hook, before out-pulsing the 
digits, as shown in Figures 1 6a to I6e. From the idle state (Figure 16a), the user 



"clicks" the Number field 151. The cursor then flashes in the Number field 1 5 1 and 
the user begins entering digits (Figure 1 6b). As digits are entered, if a match is found 
in the Phonebook, the name of the person being called is displayed in the Name field 
1 53 (Figure 1 6c) along with any label associated with die number (e.g. "Home", 
5 "Office"). Then the user clicks the "Make a Call" icon appearing in default button 63 
, or hits the "Enter'' key since the default button 63 is in "focus", in response to which 
the line is selected and the digits are out-pulsed (Figure 16d), via appropriate 
interaction between line manager 1 13 and dialling manager 135, as discussed above. 
After dialling has been completed, the call timer 155 is displayed (Figure 16e). 

10 

The user can look-up a person by name without having to open the 
Phonebook. This calling sequence is shown in Figures 17a to 17£ From the idle state 
(Figure 17a), the user "clicks" the Name field 1 53. The cursor then flashes in the 
Name field 153 and the user begins entering letters of the name of the person to be 

15 called (Figure 17b). As letters are entered, the Phonebook is searched for matching 
names, the "found" portion of a matched name is then highlighted in the Name field 
153, and a default phone number for the entry is displayed in the Number field 151 
(Figure 1 7c). The user can select a different phone number for the person being 
called, from a drop-down list 157 activated by clicking on the down arrow at the right 

20 of the Number field 151 (Figure I7d). Once the desired number is selected and 

displayed in the Number field 151 (Figure 17e), the user clicks the "Make a Call" 
icon in default button 63 or hits the "Enter** key to select the line and begin digit out* 
pulsing, as described above* After dialling has been completed, the call timer 155 is 
displayed (Figure 171). 
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Using speed dial* a user can quickly access a list of important or frequently 
called persons, without having to search the Phonebook, as shown in Figures 18a to 
1 8<L From the idle state (Figure 1 8a% the user selects the "Dial "menu item from 
menu bar 67. From the "Speed Dial" list (Figure 1 8b), a name and preferred number 
30 are selected. The selected name and number are displayed (Figure 1 8c), a line is 

selected and out-pulsing begins as described above, and the default button 63 changes 
its icon to "Hang Up". Once the dialling is complete, the call timer 155 starts (Figure 



LI 

18d). 

According to another feature of the present invention, the user can drag and 
drop (i.e. cut and paste) text from another application in order to make a call or 
S perform a search. Thus, from the idle state (Figure 19a), the user can highlight a 

portion of text 159 (usually a person's name) from another application which supports 
drag and drop functionality (e.g. word processor, spreadsheet, Microsoft Exchange®, 
etc.), and drag the text out of the application and into window 57. As the user drags 
the text over the Name field 153, a drop symbol 161 appears under the mouse pointer 

10 (Figure 19b). Upon dropping the text in the Name field 153, the Phonebook is 

automatically searched and in response to a match the default number associated with 
the matched name is displayed in the Number field 151 (Figure 1 9c). By clicking on 
the default button 63 or hitting the "Enter" key, a line is selected and digit out-pulsing 
begins as described above (Figure 19d). Once the dialling is complete, the call timer 

15 155 starts (Figure 19e). 

Once the user has completed the call, the handset 1 1 can be returned to its 
cradle or the user can press the speaker key on telephone set 1. The user can also 
hang-up from main window 57 by clicking on the "Hang Up" icon of default button 
20 63 or hitting the "Enter" key (Figure 20a). While disconnecting, the line status 

displays the "Hanging Up' message 147 (Figure 20b% and firMyuie display returns 
to te idle state (Figure 20c). Meanwhile, the call control manager 1 17 gets the call 
data from the line manager 1 13 and passes it to the smart data access manager 121 
which creates a call log entry. Then the call object is deleted. 

25 

C. Conversation Modes 

When the user is in a conversation with another party, the call can be in the 
following states: 

30 

L handset conversation 

EL speaker phone conversation 



UL on hold 
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When the user wishes to switch between conversation modes* the main 
window component 83 sends a request to the call control manager 1 1 7. The call 
control manager forwards the request to the line manager 1 13 which updates the call 
object's call state to the appropriate conversation mode. 

D. Central Office 3-Way Call 

When the user wishes to initiate a 3-way call, the main window manager 83 
sends a request to the dialling manager 135. The connection with the first party is 
established as described in the "Outgoing call" section appearing above. When the 
required call progress event(s) are received by the call control manager 117, the call 
control manager obtains the dial string required to call the third party from the 
dialling manager 135 and requests the line manager 1 13 to diaL When the next 
required call progress event(s) are received, the call control manager 1 17 obtains the 
dial string required to connect the three parties and sends it to the ling manage H3 
for dialling. 

E. Call Waiting 

The main window manager 83 sends requests to switch between calls to the 
dialling manager 135. The dialling manager then sends the appropriate dial strings to 
the call control manager 1 17 which forwards them to die line manager 1 13 for 
dialling, 

F. Extension In Use Detection 

According to another aspect of the present invention, if another extension on 
the line with which the application 17 is associated is taken off-hook, the phone 
manager 115 is informed. In response, the phone manager notifies the call control 
manager 1 17 which modifies the line's state using the line manager 1 13 and forward 



the notification to the main window manager 83. The main window manager then 
causes the main window to display an in use state indicator in display area 61, as 
shown in Figure 21. 

G. Adding a Person to Phonebook and Opening Profile 

The user can add a caller or called party to the Phonebook, including CUD 
information. From the connected state (Figure 22a), the user rolls the mouse pointer 
10 over the control bar actuator 65 (or, alternatively enters Alt + M on the keyboard 
12), which causes the control bar 79 to appear (Figure 22b). The user then clicks on 
the "Add to Phonebook" icon in function button 81, which causes the Phonebook 
window 163 to open to a "New Entries" display (Figure 22c), thereby presenting the 
user with a list of new entries including the entry for the connected party 165 which is 
highlighted. The "New Entries" display is indicated as being open at the directories 
display appearing on the left side of window 1 63 .The main window 57 remains in the 
background. 

Within the Phonebook window 163, the user can move or main, copies of 
entries by dragging entries from one list to another using the mouse pointer 10, or can 
search for entries using a "Find" command in the Tools menu of menu bar 164. 

From within the Phonebook window 163, the user can access a profile for any 
entry by clicking the "open profile" button 167. Initially, the profile window 169 
opens with the "Notes" tab 171 open (Figure 22d), thereby presenting the user with a 
list of notes (including sound files) relating to that person. However, by clicking on 
the appropriate tab the user can also open the Work tab (Figure 23 a), Home tab 
(Figure 23b), Phone tab (Figure 23c), Personal tab (Figure 23d) or Shortcuts tab 
(Figure 23e). 

The directory component 95 uses the smart access manager 121 to add, 
delete, read and modify data accessible from the Phonebook (including the profile). 
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H. Retrieving a Message 

The user can retrieve any new voicemail message from the main window 57, 
which provides an indication of the presence of waiting voicemail by the flashing 
icon 75 (Figure 24a) and a tool tip indicating the number of messages when the mouse 
pointer 10 passes over the icon 75 (Figure 24b). A right click on the mouse pointer 10 
when positioned over the icon 75 opens a shortcut menu 172 for opening the Call Log 
(Figure 24c) to play the messages. To display the Call Log (as well as the Redial list, 
the Calls Missed list or the Calls Answered list), the main window component 83 
requests the required information from the smart data access manager 121. Call log 
window 1 73 opens over the main window 57 and within a Voicemail subdirectory of 
the Calls Received directory displays the stored voicemail messages (Figure 24d). 

Double clicking on the message icon 1 75 opens a recorder window 1 77 for 
automatically playing the voicemail message. Audio recording and playback requests 
from the user interface are sent to the smart data access manager 121 which returns an 
audio file ID. Requests to pause, stop, play, rewind, fast forward, etc. the media 
stream are sent to the media message control manager 133 using the audiofile ID. 

I. Customized Diallers 

According to another aspect of the invention, customizable diallers are 
provided via die software application 1 7 for allowing the user to create multiple 
unique dialling sequences which can be implemented during a single telephone call. 
This is particularly useful for navigating automated answering and information 
systems such as voice mail, telephone help lines, etc. 

With reference to Figures 25a through 25d, various window displays are 
provided showing operation of the diallers feature according to the first embodiment. 
In Figure 25a, the dialler feature is shown being accessed via the Tools menu 74 of 
main window 57. As shown in Figure 25b, the dialler window 179 comprises a series 
of user defined categories or sections 1 8 1 of telephone numbers, office extensions or 
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access codes, etc. By clicking on any section 181, the section may be opened or 
closed, while a right click on the mouse opens a menu for editing, opening/closing, 
etc. Figure 25c shows a particular section 181 (i.e. "Citizen Info Line") in the open 
state. As in d icat e d above, a double click on the name of the section closes it again. In 
the open state focus is initially on the first of a plurality of user buttons 183. By 
clicking on the focussed button or pressing the Enter key on keyboard 1 2, the number 
associated with the button is dialled and focus shifts to the next button. Each dialler 
button 1 83 can start a new calL continue a call in progress, or hang up. Standard 
modem dialler modifiers of the modem 23 are used to insert pauses, wait for dial tone, 
hookflash, etc., in a well known manner. In this way, a user is able to navigate 
through a complex series of dialling sequences without being required to memorize 
the sequence or wait for on-line instructions. As shown in Figure 25d, any button can 
be edited by effecting a right mouse click when the cursor is over the desired button 
1 83. Likewise, a category or section 181 can also be renamed, deleted or added. 

With reference to the alternative embodiment of Figures 5a though 5c above, 
the receptionist icon 73 was disclosed as providing access to a plurality of call 
features such as call screening, call blocking, greetings and personal messages. Upon 
clicking the receptionist icon 73, a "Personal Assistant" window 1 85 is displayed as 
shown in Figures 26a though 26d. The Personal Assistant window 1 85 includes a 
plurality of tabs identified as Call Screening (Figure 26a), Call Blocking (Figure 26b), 
Greetings (Figure 26c) and Personal Messages (Figure 26d). The functionality of each 
of these features is described within the window tabs of Figures 26a though 26d. 

In Figures 27a through 27£ a configuration window 1 87 is shown having 
multiple user selectable tabs for configuring the phone I and application 17. This 
window is generated by the application configuration dialog 89 and phone 
configuration dialog 91 discussed above, and is launched from the Option menu 
selection from Tools menu 57 (Figure 25a). 

With reference to Figure 27a, a Sounds tab 1 89 is provided to enable the user 
to customize up to three different ring styles for the telephone set 1 and to assign 



predetermined sounds to call states such as "Answering to Hold", "Music on Hold", 
"Hold Reminder" and "Start recording beep ? \ A Sounds button 190 causes a Sound 
Manager window to open, as shown in Figure 28, 

With reference to Figure 27b, an Incoming Calls tab 191 is shown for 
specifying whether the first ring should be silenced, how the ring should be generated 
, auto-answering options and automatic launching of application 17 and opening of 
contact profile based on CLDD. 

Figure 27c shows the Audio Devices tab 193 for specifying whether the 
telephone set 1 or computer 7 are used for recording and listening to sounds and 
messages. 

In Figure 27d, a Function Buttons tab 195 is shown which allows the user to 
assign functions to the programmable function keys IS. The user can assign either a 
special function, a speed dial, or a combination of both, to the keys i 5. A designation 
Card portion 196 of the window is used to print an overlay card for identifying the 
functions/speed dials assign*** to the various keys IS. As shown, the user can select 
the font, font size, printer and can then depress a Print Card button 193 which causes 
the card to be printed with the selected functions/speed dials appearing thereon. 

Figure 27e shows the Voicemail tab 197 for configuring voicemail recording 
and retrieval features. 

Figure 27f shows the Miscellaneous tab 199 for configuring various telephone 
and application preferences. 

As discussed briefly above, various sounds may be recorded and assigned to 
accompany predetermined functions. Figure 28 shows a Sound Manager window 20 1 
for effecting such sound recording and editing, with available sounds being selected 
from a drop-down list A sounds button 190 appears in each window in which the user 
is permitted to select a sound (e.g. the Sounds tab of Figure 27a), the depression of 



which causes the Sound Manager window 201 to appear. 

The above call scenarios are of an exemplary nature for describing how the 
application 1 7 and engine components of core 27 function, and are not intended to be 
exhaustive. Numerous other call scenarios are supported by the functionality set forth 
herein. 
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CLAIMS: 

1 . A computer-based telephony system, comprising: 

a telephone set for implementing telephony functions on a telephone line, said 
5 telephone set including a serial interface for bidirectional communication of <fa ta 
signals; and 

a computer executable software application for receiving first ones of said 
data signals from said telephone set and in response implementing predetermined 
software functions, and for transmitting further ones of said H*t^ signals to said 
1 0 telephone set in response to a user input whereupon said telephone set implements 
predetermined ones of said telephony functions. 

2. The computer-based telephony system of claim 1 , wherein said computer 
executable software application generates and displays a window including an area 

1 5 for indicating telephone call status responsive to one of either user input or receipt of 

said-first ones of said data signals, and context sensitive buttons for initiating one or 
more of said telephony functions which are appropriate to said telephone call status. 

3. The computer-based telephony system of claim 2, wherein at least one of said 
20 buttons is a default button adjacent said area for indicating telephone call status, said 

default button being provided for user initiation of a pre fe r re d one of said telephony 
functions which is appropriate to said telephone call status. 

4. The computer-based telephony system of claim 3, wherein said window 

25 includes a control bar of further ones of said buttons which are sequentially arranged 
adjacent said default button for user initiation of respective further ones of said 
telephony functions which are appropriate to said telephone line status. 

5. The computer-based telephony system of claim. 3, wherein said default button 
3 0 has focus in said window such that said pr e f e r red one of said telephony functions may 

be initiated by pressing an Enter key on a computer executing said application. 



6. The computer-based telephony system of claim 4, wherein said control bar is 
generated and displayed only in response to a predetermined user input 

7. The computer-based telephony system of claim 2, wherein said context 
sensitive buttons are identified by labels including at least one of an icon or text for 
describing said telephony functions which are appropriate to said telephone call 
status. 

8. The computer-based telephony system of claim 2, wherein said window 
includes a status line having icons for indicating predetermined ones of said telephony 
functions which have been implemented. 

9. The computer-based telephony system of claim 1 , wherein said telephone set 
includes a plurality of user programmable functions keys, and wherein said computer 
executable software application (I) generates and displays a window including an area 
depicting said user programmable function keys and a menu associated with each of 
said depicted programmable function keys, said menu containing a plurality of user- 
selectable ones of said predetermined software functions and said telephony functions 
to be assigned to respective ones of said programmable function keys, (ii) transmits 
predetermined further ones of said data signals to said telephone set in response to 
user selection of said predetermined software functions and said telephony functions 
whereby said telephone set assigns said predetermined software functions and 
telephony functions to respective ones of said user programmable function keys on 
said telephone set, and (iii) prints an overlay card listing each one of said 
predetermined software functions and telephony functions assigned to respective ones 
of said user programmable function keys for placement on said telephone set 

10. The computer-based telephony system of claim 2, wherein said computer 
executable software application maintains a phonebook database and generates and 
displays a phonebook window including an area for indicating names and defeult 
telephone numbers of frequently called persons and a button for initiating a call to a 
selected one of said persons. 



I L The computer-based telephony system of claim 10, wherein said computer 
executable software application generates a profile window associated with each of 
said frequently called persons, for each of said persons said profile window including 
a graphic image of that person, the person's first and last name, and a plurality of 
selectable tabs for selectively displaying additional information concerning the person 
and options for automatic implementation of selected ones of said predetermined 
telephony functions and predetermined software functions. 

12. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a notes tab for displaying textual notes and icons for 
initiating playback of sound files associated with said person. 

13. The computer-based telephony system of claim 1 1, wherein one of said 
plurality of selectable tabs is a work tab for displaying full work address for said 
person. 

1 4. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a home tab for displaying a full home address for said 
person. 

1 5. The computer-based telephony system of claim 1 1, wherein one of said 
plurality of selectable tabs is a phone tab for displaying a plurality of telephone 
numbers associated with said person in addition to the default telephone number for 
said person. 

16. The computer-based telephony system of claim 11, wherein one of said 
plurality of selectable tabs is a tab for customizing greetings to be played when said 
person calls. 

1 7. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a shortcuts tab containing a field for displaying icons 
representing additional software applications which can either be automatically 
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executed in response to one or both of calls being placed to said person or received 
from said person or manually executed by mouse clicking on said icons. 



1 8. The computer-based telephony system of claim 2, wherein said window 
further includes an information display area for displaying name, telephone number 
and graphic image of a called or calling party. 

19. The computer-based telephony system of claim 1 8, wherein said computer 
executable software application maintains a phonebook database including said name, 
telephone number and graphic image, and automatically searches said database in the 
event of an incoming call containing caller line identification data for a match 
between said caller line identification data and said telephone number and in the event 
of a match automatically displays said name, telephone number and graphic image in 
said display area of said window. 

20. The computer-based telephony system of claim 1, wherein.said computer 
executable software application includes a user customizable dialler for dialling a 
plurality of numbers associated with a user defined category in accordance with a user 
selected dialling sequence. 

21. The computer-based telephony system of claim 20, wherein said computer 
executable software application displays a window showing a user selected nam- for 
each said category and a plurality of buttons each with a user selected label. 

22. A computer based telephony system substantially as 
hereinbefore described with reference to the acccnpanying drawings. 
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